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A BILINEAR-QUADRATIC  DIFFERENTIAL  GAME  IN  ADVERTISING 

by 

K.  Deal 
S.  P.  Sethi 
G.  L.  Thompson 

ABSTRACT 

A duopolistic  extension  of  the  Vidale-Wolfe  advertising  model 
is  formulated  as  a problem  in  differential  games.  An  important  feature 
of  the  problem  is  the  presence  of  reaction  terms  driven  by  the  difference 
in  the  advertising  expenditures  of  the  two  duopolistic  firms  under  consider- 
ation. Formula  for  the  Nash  turnpike  is  derived  using  the  maximum  principle. 
Several  competitive  encounters  with  different  parameters  of  the  model  are 
numerically  solved.  Tentative  conclusions  are  drawn  by  analyzing  these 
results. 
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1 1.  INTRODUCTI ON 

As  one  of  the  earliest  management  science  applications  to  marketing, 
Vidale  and  Wolfe  [ 1]  developed  a simple  model  of  sales  response  to  advertis- 
ing that  was  consistent  with  their  experimental  observations.  They  argued 
that  changes  in  rate  of  sales  of  a product  depend  on  two  effects,  response  to 
advertising  which  acts  (via  the  response  constant  b)  on  the  unsold  portion 
of  the  market,  and  loss  due  to  forgetting  which  acts  (via  the  decay  constant  a) 
on  the  sold  portion  of  the  market.  Ihus 


x = bu(l-x)  - ax,  x(0)  = xr 


(1.1) 


where  x is  the  markef  share  (i.e.,  the  rate  of  sales  expressed  as  a 
fraction  of  the  market  potential  or  saturation  level)  and  u is  the  rate  of 
advertising  expenditure  (a  control  variable)  at  time  t. 

Whereas  Vidale  and  Wolfe  offered  their  model  primarily  as  a description 

/ 

of  actual  market  phenomena  represented  by  cases  which  they  had  observed, 

Sethi  [2 ,3] formulated  an  optimal  advertising  model  with  the  Vidale-Wolfe  model 
as  its  dynamics.  He  obtained  complete  solutions  for  many  variants  of  the 
optimal  control  problem  so  formulated;  see  also  Sethi  [4]. 

Deal  and  Zionts  [5]  and  Deal  [6]  offered  a duopolostic  extension  of 
the  Vidale-Wolfe  advertising  model  and  treated  the  problem  by  the  differential 
game  approach.  With  indices  1 and  2 denoting  the  two  duopolists,  respectively, 
we  can  describe  their  dynamics  as  follows: 


1 
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*!  = b1u1(l-x1-x2)  - a^Xp 

*2  " b2U2(1"xl'x2)  ‘ a2X2’ 

The  main  problem  with  their  dynamics  is  the  absence  of  a competitive  term, 
i.e.,  in  their  model,  the  competitor's  advertising  expenditure  has  no  direct 
effect  on  a firm's  market  share.  This  drawback  has  led  us  to  the  modified 
differential  game  model  to  be  described  in  the  next  section. 

The  plan  of  this  paper  is  as  follows.  Section  2 contains  our  formula- 
tion of  the  bi-linear  quadratic  differential  game.  In  Section  3 we  apply  the 
appropriate  maximum  principle  [7]  to  obtain  necessary  optimality  conditions. 
Section  4 deals  with  the  analysis  of  the  infinite  horizon  version  of  the 
problem  and  obtains  the  steady  state  Nash  equilibrium  solution,  which  we 
term  as  Nash  turnpike.  Computational  analysis  of  finite  horizon  versions 
of  the  problem  is  presented  in  Section  5.  These  problems  are  numerically 
solved  by  applying  a two-point-boundary-value  algorithm.  We  perform  sensi- 
tivity analysis  of  the  answers  by  varying  the  parameters  of  the  problem. 
Section  6 concludes  the  paper. 

2.  THE  BILINEAR  QUADRATIC  MODEL 

The  state  equations  of  the  bilinear  model  are  modifications  of  (1.2); 
they  are 

X1  * biui^1_xi"x2)  + e1(u1-u2)(x1+x2)  - ajXj,  Xj(0)  = x1Q 


xl(°)  - x1Q 


x2(0)  “ x20* 


(1.2) 


(2.1) 
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Subject  to  these  equations,  firm  1 wants  to  maximize 


Ji  * wie  °Txi(t>  + I ^cixi  " ui)e"pt<it 


(2.2) 


while  firm  2 wants  to  maximize 


T 

J2  * W2e  PTjc2^T^  + T (c2x2  " u2^e  Pt<lt* 


(2.3) 


where  p is  the  constant  discount  rate,  c^,  c^,  w^,  w ^ are  constants,  and 
T is  the  horizon  time.  The  problem  defined  by  (2.1)  - (2.3)  is  a non- zero 
sum  differential  game,  see  [ 7,  8 ] . 

The  salient  feature  of  this  model  is  that  it  contains  reaction  terms 
of  the  form  e^Uj-Uj) (x^+x^)  and  e^Uj-u^Kx^+x^.  To  explain  these  terms 


assume  e^  * e ^ and  u^  > u^.  The  term  e^(u^-U2)x2  represents  the  persons 


the  term  e^(u^~u2^xi  is  an  approximation  (and  simplification)  of  the  Ozga 


3.  APPLICATION  OF  THE  MAXIMUM  PRINCIPLE 
To  apply  the  maximum  principle,  we  formulate  a Hamiltonian  for  each 
player  as  follows: 


who  switched  from  firm  2 to  firm  1 because  of  the  excess  advertising  of  firm  1; 


type  term  representing  the  number  of  people  switching  from 

firm  2 to  firm  1 as  a result  of  the  indirect  or  word  of  mouth  advertising 
stimulated  by  the  excess  advertising  of  firm  1.  Since  the  total  number  of 
people  going  from  firm  2 to  firm  1 is  ej(u^-U2)(Xj+X2) , these  people  must 
be  subtracted  from  the  second  state  equation.  A similar  analysis  works 
when  u^  < . Another  reason  for  making  these  assumptions  is  to  end  up  with  a 

simple  bilinear  model. 
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Hi  * cixrui  + >^iibiui<1-xrx2)  + ei(uru2)(xi+x2)  • aixi] 
+ X2lb2u2(l-x1-x2)  + e2(u2-“1) (Xl+x2)  - a2x2l 

H2  = C2X2~U2  + Yl^blUl^1-XrX2^  + el ^ul"u2 ^ ^xl+x2 ^ " alxl^ 

+ v2[b2u2(l-x1-x2)  + e2(u2-u1)(x1+x2)  - a^] 

where,  the  current-value  adjoint  variables  and  X2  and  ^ and  y2 

the  following  differential  equations: 

Shi  m 

xx  = pXi  • = -n + xi[p+ai+biui  - ei(vu2)] 

+ X2tb2u2  - e^-u^] 

BH. 

h ■ - sq  * H[bi“i  - ei(ur“2)I 

+ X2 [ p + a2  + b2U2  ~ e2^u2~Ul^ 

Yi  = PYi  “ a^  = Yilp  + ai  + Vi  ' ei(uru2)] 

+ Y2[b2u2  ■ e2(VUl)] 

dH9  M 

y2  = py2  • *r2  = ”C2  + YlfblUl  ‘ el(ul"U2)] 

1 + Y2^P  + a2  + b2U2  ~ e2^u2~Ul^* 

Also,  these  adjoint  variables  satisfy  the  transversality  conditions: 


• •*>•<  •*  X -t.  -v-y  ai  ■ -“Y  iXt  i^jfil  i*  ■ 


(3.1) 


(3.2) 


satisfy 


(3.3) 


(3.4) 


(3.5) 


(3.6) 
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Xj(T)  = w1 

9 

x2(t) 

yx(t)  = 0 

9 

Y2(T) 

(3.7) 


Since  the  Hamiltonian  maximizing  conditions  are  necessary  and  sufficient 
for  the  bilinear  quadratic  problem  (see  [7]),  we  obtain  the  form  of  the 
optimal  controls  as: 


I.  , 

— = 0 =*  Uj  = j [\1{b1(l-x1-x2)  + e^Xj+x^} 


- X2e2(x1~x2)] 


(3.8) 


6",  i 

— = 0 - u2  = - [Y2(b2(l-xrx2)  + e2(x1+x2)) 


- y1e1(x1+x2)] 


(3.9) 


If  we  substitute  (3.8)  and  (3.9)  into  (2.1)  and  (3.3)  - (3.7),  we 
obtain  the  two-point-boundary  value  problem,  which  when  solved,  yields  optimal 
advertising  for  the  two  firms.  This  will  be  carried  out  in  Section  5.  In 
the  next  section,  we  take  up  the  analysis  of  the  infinite  horizon  problem  and 
obtain  the  expression  for  the  Nash  turnpike. 


4.  DERIVATION  OF  THE  NASH  TURNPIKE 

For  this  derivation  we  assume  T * ® and  modify  the  objective  functions 
of  (2.2)  and  (2.3)  as  follows: 


J1  = J*  (c^  - uj)e"ptdt 

J2  = J*  <c2X2  ' u2)e’Ptdt  * 


(4.1) 

(4.2) 
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1 


The  differential  game  problem  involves  firm  1 trying  to  maximize  (4.1)  and 

firm  2 trying  to  maximize  (4.2)  subject  to  conditions  (2.1). 

To  determine  the  Nash  turnpike  we  set  the  right  hand  sides  of  (2.1) 

and  (3.3)  - (3.6)  equal  to  zero  and  solve  these  six  equations  along  with 

(3.8)  and  (3.9).  This  gives  a system  of  8 bilinear  equations  in  8 variables. 

We  now  sketch  the  reduction  of  this  system  to  two  simultaneous  cubic  equations 

3 

in  Uj  and  u 2*  However,  one  equation  has  no  term  in  u^  and  the  other  has 

3 

no  term  in  u2»  It  is,  therefore,  possible  to  solve  these  equations  by  an 


iterative  application  of  the  quadratic  formula. 

The  eight  equations  to  be  solved  are 

-a^  + b1u1(l-x1-x2)  + e1(u1-u2)(x1+x2)  = 0 (4.3) 

-a2x2  + b2u2(l-x1-x2)  + e2(u1-u2)(x1+x2)  = 0 (4.4) 

'C1  + xi[P+ai+biui"ei(ui"u2^  + *-2^b2U2”e2^u2"Ul^  = ° (4.5) 

X2lp+a2+b2u2  - e2(u2-u1)]  + X1lb1ui“e1(u1_u2)l  * 0 (4.6) 

Vi r fT*-3 i+h  1^1  “ ei(ui"u2)J  + Y2fb2u2-e2(u2-u1)J  = 0 (4.7) 


”c2  + V2f P+a2+b2u2  " e2(u2"ul^  + Yl^blul  " ei(ui"u2^  =0  (4-8) 
2ux  » X1[b1(l-x1~x2)  + e1(x1+x2)]  - X2e2(x1+x2)  (4.9) 

2u2  = Y2^b2^”Xl~X2^  + e2^xl+x2^  " Ylel(xl+x2^  * (4.10) 

Subtracting  (4.6)  from  (4.5)  and  (4.8)  from  (4.7)  we  obtain 

C1  + X2(a2+P) 

X1 


(4.11) 
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Y2  = 


C2  + Yl(al+P) 
a2  + P 


Substituting  (4.11)  into  (4.6)  and  (4.12)  into  (4.7)  yields 


(4.12) 


cl^el^ul“u2^  " blul* 


D(p) 


(4.13) 


where , 


c2le2(“2-“l)  - V21 

D(p) 


D(p)  = (aj+p) (a2+p)  + (flj+p)b2u2  + (a2+p)b^Uj 
+ (u1-u2)[(«1+p)e2  - (a2+p)e1l 


(4.14) 


(4.15) 


Multiplying  (4.3)  by  a2  and  (4.4)  by  a^  and  adding  gives 


X1  + x2  “ 


a2blUl  + alb2U2 
D(0) 


(4.16) 


Putting  (4.11),  (4.13)  and  (4.16)  into  (4.9)  and  multiplying  by 
D(0)D(p)(aj+p)  and  putting  (4.12),  (4.14)  and  (4.16)  into  (4.10)  and 
multiplying  by  D(0)D(p)(a2+p)  gives  the  following  system  of  two  cubic 
equations  in  u^  and  u2: 

2D(0)D(p)(a1+p)u1  = cjb^D(0)D(p)  + [ (a2+p)c  - (a^p^e^ 


[e^(u^-u2)  - b^u^] ^a2blul  + alb2U2^ 


+ (a2+p)c1b1[e1(u1-u2)-b1u1]D(0) 

+Cl(el'bl)  (a2blUl  + a1b2u2)D(P)* 


(4.17) 


r p 


L_ 
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2D(0)D(p)  (a2+p)u2  = c2b2D(0)D(p)  + [ (a1+p)c2(e2-b2)  - (a^pjc^]- 

[e2(u2-u1)  - b2u2^a2blUl+alb2U2^ 

(4.18) 

+ {^^-p)c^>2[e2  (u2-u1)-b2u2]D(0) 

+ c2(e2-b2^a2blUl  + aib2u2^D(P^‘ 

Multiplying  these  out  and  collecting  terms,  we  can  rewrite  these 
equations  in  the  following  form: 


1 


“lUl  + ^1U1U2  + 61U1U2  + ^'1U1  + eiUlU2  + '*’lU2  + ei  = 0 (4.19) 

a2U2  + ^2U1U2  + 62U1U2  + ^2U2  + 02U1U2  + ^“l  + e2  = ^-2°) 

where  coefficients  ar^ , Pi , 6^,  0^,  , and  for  i = 1,2  can  be 

expressed  as  lengthy  expressions  in  the  original  parameters. 

Equations  (4.19)  and  (4.20)  are  two  simultaneous  cubic  equations  in  u^ 
and  u2  which  can  be  solved  by  a number  of  methods,  provided  a real  solution 

exists.  Note  that  for  fixed  u^,  equation  (4.19)  is  quadratic  in  u2;  and 

for  fixed  u2>  equation  (4.20)  is  quadratic  in  u^.  Thus  there  is  a possibility 
of  developing  an  algorithm  that  alternates  between  the  solutions  of  two 
quadratic  equations.  ‘ 

Instead  of  solving  (4.19)  and  (4.20)  we  intend,  in  a later  paper,  to 
extend  the  numerical  solution  procedure  of  the  next  section  to  problems  with 
large  T,  and  to  observe  the  steady  state  values,  and  check  to  see  whether 
they  satisfy  the  two  equations. 


J 
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5.  NUMERICAL  SOLUTION  OF  THE  FINITE  COMPETITIVE  MODEL 
From  section  3,  the  necessary  and  sufficient  conditions  for  opti- 
mality provide  two  system  equations  each  with  a specified  initial  condition 
(2.1),  four  adjoint  equations  (3.3  - 3.6)  with  their  four  terminal  conditions 
(3.7),  and  the  ti'o  equations  for  the  control  variables  (3.8,  3.9). 

The  algorithm  is  initiated  by  guessing  values  for  each  competitor's 
controls  for  each  discrete  instant  of  time  during  the  planning  horizon. 

The  system  equations  are  then  functions  of  the  state  variables  only  and 
can  be  solved  numerically  forward  in  time  by  using  the  specified  initial 
conditions.  At  each  forward  step  of  the  solution,  the  values  of  x^(t)  are 
calculated  and  stored.  The  values  of  the  performance  indices  are  calculated 
during  each  forward  pass. 

At  terminal  time,  the  terminal  conditions  on  the  adjoint  variables 
are  calculated  and  are  used  in  the  solution  of  the  adjoint  equations  backward 
in  time.  At  each  successive  time  decrement  of  the  backward  pass,  the 
appropriate  values  of  the  adjoint  variables  are  determined  along  with  a new 
set  of  control  variable  values.  When  back  at  the  initial  time,  there  is  a 
revised  time  sequence  of  values  for  the  control  function.  These  are  used 
in  the  next  forward  pass,  the  objective  of  which  is  to  evaluate  the  effect 
of  these  new  controls  on  the  performance  indices.  At  the  end  of  each  forward 
pass  a stopping  criterion  is  evaluated.  When  the  iterative  procedure  has 
been  terminated,  the  solution  is  checked  against  the  Nash  equilibrium 
property.  During  extensive  testing,  the  algorithm  exhibited  stability  and 
realistic  convergence  properties  while  consistently  obtaining  Nash  solutions. 

Using  the  numerical  algorithm,  we  have  investigated  many  competitive 
encounters  by  varying  the  parameter  values  individually  and  in  combination. 
The  computer  runs  provide  information  on  the  values  of  the  performance 

I I 
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indices,  the  state  and  control  variables  and  the  adjoint  variables  at  each 
instant  of  time  during  t;he  planning  horizon.  Computer  generated  graphs 
of  this  information  are  also  obtained. 

Limited  space  does  not  allow  for  an  extensive  presentation  of  the 
numerical  results.  For  illustrative  purposes,  we  present  two  extreme 


The  first  case  j.s  a sequence  of  four  encounters  where  the  two  com- 
petitors are  identical  except  for  one  attribute,  the  speed  of  sales  decay. 

The  firms  have  the  same  moderate  sales  response,  relatively  low  competitive 
reaction  and  low  initial  market  saturation.  Both  firms  are  attempting  to 
maximize  profit  over  the  finite  planning  period.  The  sales  decay  parameter 
for  Firm  1 remains  at  the  same  moderate  level  during  the  four  encounters. 

Firm  2 has  a very  low  rate  of  decay  in  encounter  1.  This  decay  increases 
until  it  is  identical  to  Firm  l's  decay  in  encounter  3 and  is  larger  than 
Firm  l's  in  encounter  4.  The  parameter  values  are  found  in  Table  1. 

The  graphical  results  are  presented  in  Figure  1.  The  labelling  of 
the  curves  is  iUj  for  the  advertising  curves  and  iXj  for  the  market  share 
curves  where  i refers  to  the  encounter  number,  i = 1,...,  4,  and  j indicates 
the  firm  number,  j =1,  2.  For  example,  in  Figure  la  the  optimal  advertising 
expenditures  path  for  Firm  2 during  encounter  1 is  indicated  by  1U2.  Firm 
2's  resulting  market  shares  path  is  labelled  1X2  in  Figure  lb. 

The  time-phased  advertising  and  market  share  paths  should  appeal  to  a 
realistic  explanation  from  a "marketing  common  sense"  standpoint.  Since 
the  firms  are  concerned  with  maximizing  profit  over  the  current  planning 
period  only,  it  would  be  expected  that  the  firms  should  spend  their  advertising 
dollars  to  gain  maximum  performance  index  value  before  the  end  of  the  period. 

To  these  firms  the  carryover  of  market  share  response  to  the  next  period  is 
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TABLE  1 


(Encounters  1-4) 


i 

ai 

bi 

ci 

C . 

1 

wi 

Ji 

xi(0) 

x±(T) 

1 

.25 

.005 

.01 

200 

0 

69.55 

.10 

.020 

2 

.05 

.005 

.01 

200 

0 

211.18 

.10 

.149 

1 

.25 

II 

II 

ii 

II 

76.45 

II 

.022 

2 

.10 

162.45 

.091 

1 

.25 

II 

II 

n 

II 

86.32 

II 

.025 

2 

.25 

86.32 

.025 

1 

.25 

• 1 

II 

ii 

II 

87.90 

II 

.025 

2 

.30 

72.93 

.017 

wasted  money.  Consequently,  advertising  expenditures  should  decrease  to 
zero  by  the  end  of  the  term.  In  encounter  1 Firm  2 has  a much  slower  decay 
of  market  share  (greater  carryover)  than  does  Firm  1.  Although  the  immediate 
response  to  advertising  expenditures  is  identical,  Firm  2 obtains  significantly 
greater  total  effect  for  each  dollar  spent.  Firm  1 is  overwhelmed  by  Firm  2. 
Firm  2 is  able  to  obtain  a substantially  larger  total  profit  and  increase 
its  market  share  by  spending  more  than  twice  Firm  l's  amount  initially  and 
tapering  to  zero  by  terminal  time.  Firm  1 finds  that  a subsistence  level 
of  advertising  allows  it  to  "maximize"  profit  in  a decidedly  dominated 
situation. 

As  shown  in  Table  1,  the  decay  parameter  of  Firm  1 increases  until 
it  becomes  larger  than  2's  decay  in  encounter  4.  Naturally,  the  advertising 
and  sales  paths  are  quite  different  in  encounters  1 and  4.  The  profit 
maximization  objective  has  been  investigated  extensively  by  holding  all  but 
one  parameter  fixed  and  varying  the  values  of  that  key  parameter  over  a 
large  range.  Also,  an  experimental  design  was  used  to  perform  model  testing. 

The  parameter  values  used  in  the  second  set  of  encounters  are 
presented  in  Table  2..  The  corresponding  graphs  are  in  Figure  2.  These 
graphs  illustrate  advertising  strategies  and  market  results  which  are 
practically  opposite  to  those  of  the  first  set  of  encounters.  Of  course, 
the  key  to  this  difference  is  the  firms'  re-orientation  to  placing  heavy 
importance  on  terminal  market  share,  as  is  indicated  by  the  value  of  the 
weight,  w,  in  the  table. 

To  illustrate  the  effect  of  the  competitive  interaction  term,  we 
present  one  last  set  of  encounters  in  Table  3 and  Figure  3.  As  shown  in 
the  "e"  column  of  Table  3,  Firm  1 is  dominant  in  encounter  1,  is  identical 
to  Firm  2 in  encounter  2,  and  becomes  dominated  by  Firm  2 in  encounters  3 
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TABLE  2 


(Encounters  1-4) 


i 

ai 

bl 

ei 

ci 

wi 

xA(0) 

x^T) 

1 

.25 

.005 

.01 

200 

2550 

-72.40 

.10 

.039 

2 

.05 

.005 

.01 

200 

2550 

749.89 

.10 

.389 

1 

.25 

II 

It 

II 

II 

60.65 

II 

.062 

2 

.10 

494.13 

.240 

1 

.25 

II 

II 

II 

II 

188.24 

II 

.084 

2 

.25 

188.24 

.084 

1 

.25 

II 

II 

II 

II 

202.28 

II 

.086 

2 

.30 

147.90 

.065 

I 
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TABLE  3 


(Encounters  1-4) 


i 

ai 

bi 

Ci 

Ci 

wi 

xt(0) 

xa(T) 

1 

.10 

.005 

.010 

200 

2550 

703.28 

.30 

.318 

2 

.10 

.005 

.005 

200 

2500 

791.24 

.30 

.167 

1 

• 1 

ft 

.010 

ff 

ff 

407.91 

ff 

.244 

2 

.010 

407.91 

.244 

1 

It 

ft 

.010 

ff 

ff 

-53.82 

ft 

.165 

2 

.015 

298.22 

• 

.396 

1 

If 

ft 

.010 

If 

ff 

-997.35 

tf 

.039 

2 

.020 

-62.87 

.702 

MKT.  SH.  1 PND  2 


-18- 


and  4. 


4.  w 

Over  these  encounters.  Firm  2 changes  position  from  one  in  which 
it  cannot  maintain  its  initial  market  share  during  encounter  1 to  the 
position  where  it  has  a 70!?  market  share  compared  to  Firm  l's  4%  market 
share  in  encounter  4. 

Comparison  of  the  advertising  strategies  resulting  from  profit 
maximization  (Figure  1)  and  those  resulting  from  having  a heavy  emphasis 
on  terminal  market  share  (Figure  2)  indicates  the  tremendous  differences 
between  advertising  strategies  under  these  two  performance  criteria. 
Naturally,  less  extreme  weighting  of  the  components  of  the  performance 
indices  would  produce  results  which  are  more  realistic  for  most  actual 
marketing  organizations. 

Many  advertising  executives  maintain  the  need  to  have  a very  strong 
impact  ir.  a communication  media  or  to  stay  out  of  that  media  except  for 
some  bare  subsistence  level  spending.  The  benefit  of  dominating  an  industry 
through  advertising  has  been  illustrated  strongly  by  the  last  set  of  en- 

I 

counters  which  was  based  on  variation  of  the  reaction  terms.  The  effect  of 
the  reaction  terms  will  vary  depending  upon  the  values  of  the  other  para- 
meters and  the  performance  index  weighting.  However,  the  benefit  of  adver- 
tising dominance  will  exist  in  every  case. 


6.  CONCLUSIONS 

The  model  presented  in  this  paper  has  the  conceptual  advantage  of 
combining  logically  several  critical  dimensions  of  advertising  competition. 
A benefit  of  this  model  lies  in  its  ability  to  represent  the  marketing 
characteristics  of  market  share  response  to  advertising,  decay  of  market 
share  due  to  forgetting,  the  saturation  effect,  and  the  effect  of  sales 
switching  due  to  advertising  dominance  within  the  most  natural  environment 


of  advertising  — dynamic  competition  with  multiple  objective  performance 
indices . 

We  are  encouraged  by  the  numerical  results  to  the  finite  horizon 
problem.  Our  next  stage  in  the  investigation  will  be  to  solve  numerically 
the  infinite  horizon  problem  as  proposed  in  section  4 and  to  compare  the 
results  to  the  solution  of  the  original  problem  when  a greatly  lengthened, 
but  finite,  time  period  is  used.  We  are  also  looking  forward  to  the 
research  of  a particular  industrial  situation  which  coincides  closely  with 
the  assumptions  of  this  model. 
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